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1.3.4 Discrete Probability Models 

Here, we will distinguish between two different types of sample spaces, discrete and 
continuous. We will discuss the difference more in detail later on, when we discuss random 
variables. The basic idea is that in discrete probability models we can compute the probability 
of events by adding all the corresponding outcomes, while in continuous probability models 
we need to use integration instead of summation. 

Consider a sample space S. If S' is a countable set, this refers to a discrete probability model. 
In this case, since S is countable, we can list all the elements in S : 

S — {si, S2, S3,•••}. 

If A C S is an event, then A is also countable, and by the third axiom of probability we can 
write 


p( J 4) = p(UbT) = E p ( s d- 

Sj€A Sj<EA 

Thus in a countable sample space, to find probability of an event, all we need to do is sum the 
probability of individual elements in that set. 


Example 1.12 

I play a gambling game in which I will win k — 2 dollars with probability \ for any 

2 fc 

k £ N, that is, 


• with probability ^, I lose 1 dollar; 

• with probability j, I win 0 dollar; 

• with probability , I win 1 dollar; 

• with probability I win 2 dollars; 

• with probability I win 3 dollars; 


What is the probability that I win more than or equal to 1 dollar and less than 4 dollars? What 
is the probability that I win more than 2 dollars? 

• Solution 
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o In this problem, the random experiment is the gambling game and the outcomes 
are the amount in dollars that I win (lose). Thus we may write 

S = {-1,0,1,2,3,4,5,"-}. 

As we see this is an infinite but countable set. The problem also states that 

m = P({i}) = for k e S. 

First, let's check that this is a valid probability measure. To do so, we should 
check if all probabilities add up to one, i.e., P(S) = 1 . We have 

P(S) = EE.-1 m 



= \ + \ + I H- (geometric sum) 

= 1 . 

Now let's solve the problem. Let's define A as the event that I win more than or 
equal to 1 dollar and less than 4 dollars, and B as the event that I win more than 
2 dollars. Thus, 


Then 


^ = {1,2,3}, B = {3,4,5, • • •}. 


P{A) = P(l) + P(2) + P(3) 


i + X + J_ 

8 ^ 16 ^ 32 
1 _ 

32 

0.219 


Similarly, 

P(B) = 


P(3) + P(4) + P(5) + P(6) + --- 

^ + ^ + Tk+2l6 + "' (geometric sum) 

J_ 

16 

0.0625 


Note that another way to find P{B) is to write 


P(B) = 1 - P(B C ) 


https://www.probabilitycourse.com/chapter1/1_3_4_discrete_models.php 


2/5 



9/8/2018 


Discrete Models | Finite | Countable 


= 1-P({-1,0,1,2}) 

= 1 - ( P(-l) + P(0) + P(l) + P(2) 


= 1_/I + I + I + J_) 

12 T 4 T 8 T 16i 

= 1-15 
16 

_ J_ 

16 

= 0.0625 


Note: Here we have used the geometric series sum formula. In particular, for any <2, X E M, 
we have 


n— 1 


a + ax + ax 2 + ax 3 + • • • + ax n 1 = acc fc = a— 

^ 1 

Moreover, if I X I < 1, then we have 


1 — X 


n 


k =0 


X 


(1.3) 


oo 


a + ax + ax 2 + ax 3 + • • • = 

A;=0 


ax — a- 


1 — x 


(1.4) 


Finite Sample Spaces with Equally Likely Outcomes: 

An important special case of discrete probability models is when we have a finite sample 
space S, where each outcome is equally likely, i.e., 

S — {si, S 2 , • • •, sjv}, where P(s*) = P(sj ) for all i, j E {1,2, • • •, N}. 

Rolling a fair die is an instance of such a probability model. Since all outcomes are equally 
likely, we must have 

P(si) = -jy, for all i E {1,2, • • • ,N }. 

In such a model, if A is any event with cardinality \A\ — M , we can write 

, .. —> , . ^—> 1 iW \A\ 

~ Jv ~ Js\' 

Sj<EA Sj^A 1 1 
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Thus, finding probability of A reduces to a counting problem in which we need to count how 
many elements are in A and S . 


Example 1.13 

I roll a fair die twice and obtain two numbers: X\ = result of the first roll, and X 2 — result 
of the second roll. Write down the sample space S, and assuming that all outcomes are 
equally likely (because the die is fair), find the probability of the event A defined as the event 
that X\ + X 2 — 8. 

• Solution 

o The sample space S can be written as 

5 = {(1,1),(1,2),(1,3),(1,4),(1,5),(1,6), 

( 2 . 1 ) ,( 2 , 2 ),( 2 , 3 ),( 2 , 4 ),( 2 , 5 ),( 2 , 6 ), 

(3.1) ,(3,2),(3,3),(3,4),(3,5),(3,6), 

(4.1) ,(4,2),(4,3),(4,4),(4,5),(4,6), 

(5.1) ,(5,2),(5,3),(5,4),(5,5),(5,6), 

( 6 . 1 ) ,( 6 , 2 ),( 6 , 3 ),( 6 , 4 ),( 6 , 5 ),( 6 , 6 )} 

As we see there are \S\ — 36 elements in S. To find probability of A, all we 
need to do is find M — |^ 4 |. In particular, A is defined as 

A={(X 1i X 2 )\X 1 +X 2 = 8,X U X 2 G {1,2,--.,6}} 

= {(2,6), (3,5), (4,4), (5,3), (6,2)}. 


Thus, \A\ — 5, which means that 


p( A ) - 

( } “ isi 


5 

36' 


A very common mistake is not distinguishing between, say (2, 6) and (6, 2). It 

is important to note that these are two different outcomes: (2,6) means that the 

first roll is a 2 and the second roll is a 6, while (6,2) means that the first roll is a 

6 and the second roll is a 2. Note that it is very common to write 

P\X 1 + X2 — 8) when referring to P(A ) as defined above. In fact, X\ 

and X 2 are examples of random variables that will be discussed in detail later 

on. 
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In a finite sample space S, where all outcomes are equally likely, the probability of any 
event A can be found by 


P(A) 



The formula P(A ) 


\A 

|S| 


suggests that it is important to be able to count elements in sets. 


If sets are small, this is an easy task; however, if the sets are large and defined implicitly, this 
could be a difficult job. That is why we discuss counting methods later on. 


<— previous 
next —> 
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